MOVING PICTURE REPRODUCING DEVICE AND 
METHOD OF REPRODUCING A MOVING PICTURE 



BACKGROUND QF THE INVENTION: 

Field of the Invention 

The invention relates to a method of decoding (reproducing) a 
moving picture (image signals) which is compressed in a determined 
compression method and a moving picture reproducing device which 
performs the method. In particular, the invention relales to a method of 
decoding compressed moving picture at various decoding precision 
levels (resolutions) and reproducing The decoded moving picture and a 
moving picture reproducing device which performs the method. 

Description of the Related Art 

A conventional video signal coding technology is prescribed in a 
standard, such as MPEG (Moving Picture Experts Group: which is well 
known as an International Standard of a moving picture compressing 
method), Such a coding technology is used to reduce an amount of 
Information of moving picture, and the compressed moving picture is 
used in communication and data accumulation. 

A user instructs a PC (personal computer) to reproduce the 
compressed moving picture by using a GUI (Graphical User Interface) 
implemented in an Operating System running on the PC, In this event, 
the user may change a display size of the moving picture by using a 
pointing device such as a mouse. 

The change of the display size of the moving picture is done by a 
graphic hardware, and is not related to a decoding process of the 



compressed moving picture, For example, even if the display size is 
reduced to fifty percent in a vertical and a horizontal direction, the 
decoding process is performed aboul all signals of Ihe compressed 
moving picture. However, It is to be considered That detailed 
information (high frequency component) included in the decoded 
moving picture is lost due to the reduction of the display size. 

Also, there are various display devices to display the decoded 
moving picture- In general, a single display device can display the 
image in a plurality of resolutions. Therefore, when the image is 
displayed in a low resolution or in a small display size, a size of the 
Image may be reduced so as to match with the display size. 

However, in the prior an, decoding process is performed about 
all signals of compressed moving picture, regardless of the display size. 
Thus, there is a problem that decoding process of high frequency 
components, which are not displayed after all, is performed even when 
the display size is smaller than an original display size of the moving 
picture. 

£1 1MMARY OF THF INVENTION: 

Therefore, it is an object of the invention to overcome the 
problem. 

That is, it is an object of the invention to provide a method of 
reproducing moving picture and a device to perform the method. The 
method performs decoding process according to a resolution of a 
display size, to improve a performance of reproducing the Image by 
simplifying the decoding process without degradation of image display 
quality and to generate reduced image independently of a performance 
of a graphic hardware. 



According to a first aspect of the invention , there is provided a 
moving picture reproducing device which decodes compressed moving 
picture and provides the decoded Image to a display device. The 
device comprises a plurality of decoding units each of which decodes 
the compressed moving picture in a resolution which is different from 
resolutions of the other decoding units, a display size obtaining unit 
which obtains a display size of image displayed on the display device, 
and a decoding unit selecting unit which selects a decoding unit to 
decode the compressed moving picture, from the plurality of decoding 
units according to the display size obtained by the display size obtaining 
unit. 

According to a second aspect of the invention, in the moving 
picture reproducing device of the first aspect, the decoding unit 
selecting unit is constructed to newly select the decoding unit wnenever 
the selected decoding unit decodes a predetermined amount of the 
compressed moving picture. 

According to a third aspect of the invention, in the moving picture 
reproducing device of The first aspect, when the selected decoding unit 
decodes the compressed moving picture in a resolution which is lower 
than an original resolution of the compressed moving picture, the 
decoding unit is constructed to decode them by reducing an order of 
IDCT (Inverse Discrete Cosine Transformation) and performing motion 
compensation according to the reduced order of IDCT. 

According to a fourth aspect of the invention, the moving picture 
reproducing device of the first aspect further comprises a display size 
storing device which stores the display size used when the previous 
decoding process is completed, wherein the decoding unit selecting unit 
selects, at the beginning of current decoding process, one of the 
decoding units according to the display size stored in the display size 



storing device. 

According to a fifth aspect of the invention, in the moving picture 
reproducing device of the second aspect, the moving picture is 
compressed based on MPEG and the decoding unit selecting unit is 
constructed to select the decoding unit for each GOP (Group of Picture). 

According to a sixth aspect of the invention, in the moving 
picture reproducing device of the fifth aspect, the decoding unit 
selecting unit is constructed to select, at the beginning of decoding 
process of current GOP, a decoding unit used in the decoding process 
of The previous GOP, when a B picture in the current GOP includes 
information related to an i picture and a P picture of the previous GOP. 

According to a seventh aspect of the invention, there is provided 
a moving picture reproducing device which decodes compressed 
moving picture and provides the decoded image to a display device. 
The device comprises a luminance decoding unit which decodes 
luminance component in the compressed moving picture, and a color- 
difference decoding unit which decodes color-difference component in 
the compressed moving picture, wherein the luminance decoding unit 
decodes the compressed moving picture in a resolution which is lower 
than a resolution used by the color-difference decoding unit. 

According to an eighth aspect of the invention, there is provided 
a method of decoding moving picture comprising the steps of obtaining 
a display size of image displayed on a display device, selecting a 
resolution to decode the compressed moving picture from different 
resolutions, according to The display size obtained by the obtaining step, 
and decoding the compressed moving picture in the selected resolution. 

According to a ninth aspect of the invention, there is provided a 
method of decoding moving picture comprising the steps of decoding 
luminance component in the compressed moving picture, and decoding 



color-difference component in the compressed moving picture. 
Wherein the step of decoding luminance component decodes the 
compressed moving picture In a resolution which Is lower than a 
resolution used by the step of decoding color-difference component. 

According to a tenth aspect of the invention, there is provided a 
computer data signal embodied in a carrier wave and representing a 
sequence of instructions which, when executed by a processor, cause 
the processor to perform a method of decoding moving picture. The 
method comprises the steps of obtaining a display size of image 
displayed on a display device, selecting a resolution to decode The 
compressed moving picture from different resolutions, according to the 
display size obtained by the obtaining step, and decoding the 
compressed moving picture in the selected resolution. 

According to an eleventh aspect of the invention, there is 
provided a computer data signal embodied in a carrier wave and 
representing a sequence of instructions which, when executed by a 
processor, cause the processor to perform a method of decoding 
moving picture. The method comprises the steps of decoding 
luminance component in the compressed moving picture, and decoding 
color -difference component in the compressed moving picture, wherein 
the step of decoding luminance components decodes the compressed 
moving picture in a resolution which is lower than a resolution used by 
the step of decoding color-difference component. 

BRIEF DE S CRIPTION QFTHE DRAWING S ; 

Fig. 1 shows a diagram of a moving picture reproducing device 
according to a first embodiment of the invention; 

Fig. 2 shows a flowchart describing operation of the moving 
picture reproducing device shown in Fig, 1; 
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Fig. 3 shows a diagram of a moving picture reproducing device 
according to a second embodiment of the invention; and 

Fig. 4 shows a flowchart describing operation of the moving 
picture reproducing device shown in Fig. 3. 

DESCRIPTION OF THE PREFERRED EMBODIMENT: 
[First Embodiment] 

As shown in Fig. 1 , a moving picture reproducing device 
according Lo a firs I embodiment of the invention includes a storage 
device 1 which stores a moving picture compressed in accordance with 
a compression method as original images 11. In addition, the 
illustrated device has an image data processing device 2 which 
performs decoding process on the original images 1 1 stored in the 
storage device 1 , and a display device 3 on which the decoded moving 
picture is displayed. 

The image data processing device 2 includes a compressed 
data buffer 21 , a display size obtaining unit 22 p a resolution selecting 
unit 23, a full resolution decoding unit 24, a one half resolution decoding 
unit 25, a one quarter resolution decoding unit 26, a one eighth 
resolution decoding unit 27, and a frame data buffer 28. 

The compressed data buffer 21 temporarily stores the original 
images 1 1 which are loaded from the storage device 1 , and the display 
size obtaining unit 22 obtains a display size of a display window on the 
display device 3. Further, the resolution selecting unit 23 selects a 
decoding resolution based on the display size which is obtained by the 
display size obtaining unit 22. 

The full resolution decoding unit 24 decodes all data of the 
original images 1 1 , that is, decodes the images 1 1 in a full resolution. 
The one half resolution decoding unit 25 performs decoding process of 
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the original images 11 in a half resolution in both a vertical and a 
horizontal direction. The one quarter resolution decoding unit 26 
performs the decoding process of the original images 1 1 in one quarter 
resolution in both a vertical and a horizontal direction. The one eighth 
resolution decoding unit 27 performs the decoding process of the 
original images 1 1 in one eighth resolution in both a vertical and a 
horizontal direction. The frame data buffer 28 temporarily stores the 
decoded images to be displayed. 

The resolution selecting unit 23 selects a full resolution and 
instructs the full resolution decoding unit 24 to decode the original 
images 1 1 , when the display size obtained by the display size obtaining 
unit 22 is larger than the size of the original images 1 1 . Alternatively, 
the resolution selecting unit 23 selects one half resolution and instructs 
the one half resolution decoding unit 25 to decode the original images 
1 1 , when the display size obtained by the display size obtaining unit 22 
is smaller than the size of the original images 1 1 arid is larger than half 
of the size of the original images 1 1 . 

For example, the display size obtaining unit 22 obtains the 
display size from an area storing system information or an area related 
to a moving picture reproducing application. Both the areas are 
allocated in the PC. An operating system can write the display size of 
the moving picture reproducing application in the area storing 3ystem 
information. Also, the moving picture reproducing application can write 
the display size of its own in the related area. When the display size is 
changed by, for example, a user, the display size written in the area 
storing system information or the area related to the application also is 
updated. 

Also, the resolution selecting unit 23 selects one quarter 
resolution and instructs the one quarter resolution decoding unit 26 to 
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decode the original images 1 1 , when the display size obtained by the 
display size obtaining unit 22 is smaller than the half of the size of The 
original images 1 1 and is larger than one quarter of the size of the 
original images 1 1 . Further, the resolution selecting unit 23 selects 
one eighth resolution and instructs the one eighth resolution decoding 
unit 27 to decode the original images 1 1 , when the display size obtained 
by the display size obtaining unit 22 is smaller than the one quarter of 
the size of the original images 1 1 . 

Herein, the display size and the size of the original images 1 1 
are compared in both the vertical and the horizontal direction. 
Therefore, for example, when the display size is smaller than the size of 
the original images 1 1 "in both the vertical direction and the horizontal 
direction 11 , it is determined that the display size is "smaller" than the size 
of the original images 1 1 . 

On the contrary, when the display size is larger than the size of 
the original images 1 1 "In both the vertical direction and the horizontal 
direction", it is determined that the display size is "larger" than the size 
of the original images 1 1 . 

The decoding process in lower resolution can be realized by 
reducing an order of IDCT (Inverse Discrete Cosine Transformation), 
Also, motion compensation is performed in a size corresponding to the 
order of the IDCT, Specifically, the full resolution decoding unit 24 
performs eight hy eight (pixels) IDCT while the one half resolution 
decoding unit 25 performs four by four (pixels) IDCT. In addition, 
motion compensation is also executed in the half resolution decoding 
unit 25 by reducing a macro block size to a half in a vertical and a 
horizontal direction. 

Also, the one quarter resolution decoding unit 26 performs two 
by two (pixels) IDCT and motion compensation with reducing the macro 
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block size to one quarter in a vertical and a horizontal direction. 
Further, the one eighth resolution decoding unit 27 performs one by one 
IDCT, that is, performs IDCT only for DC component and motion 
compensation with reducing the macro block size to one eighth in a 
vertical and a horizontal direction. 

Next, description is made about operation of decoding process 
of the original images 1 1 at the moving picture reproducing device 
according to the first embodiment of the invention, with reference to 
Fig. 2. 

Herein, It Is assumed that the original Images 1 1 stored In the 
storage device 1 are compressed based on MPEG. 

At first, the original images 1 1 are loaded from the storage 
device 1 into the image data processing device 2, and then the original 
images 1 1 are transferred to the compressed data buffer 21 (step S202). 

Next, the resolution selecting unit 23 determines whether the first 
picture of the original images 1 1 is processed or not (S203). When the 
first picture is processed, the resolution selecting unit 23 selects the full 
resolution decoding unit 24 to process the first picture of The original 
images 1 1 (S204). Then, the full resolution decoding unit 24 performs 
decoding process on the first picture in a full resolution (S205) and 
transfers decoded first picture, that is, data to be displayed to the frame 
data buffer 28 (S206). The decoded first picture is then displayed on 
the display device 3 (S207). 

When a received picture is not the first piclure, Ihe resolution 
selecting unit 23 determines whether the picture is at the beginning of 
GOP (Group of Pictures) or not (S208) . When the picture is at the 
beginning of GOP, the display size obtaining unit 22 instructs to obtain 
the display size of a display window displayed on the display device 3. 
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The resolution selecting unit 23 determines whether the display 
size obtained by the display size obtaining unit 22 is larger than the size 
of the received picture or not (S209). When the display size is larger 
than the size of the received picture, the resolution selecting unit 23 
selects the full resolution decoding unit 24 to decode the picture. Then 
the full resolution decoding unit 24 decodes the picture in a full 
resolution (S205), and transfers the decoded picture, that is, data to be 
displayed to the frame data buffer 28 (S206). After that, the decoded 
picture is displayed on the display device 3 (S207). 

When the obtained display size is not larger than the size of the 
received picture, the resolution selecting unit 23 determines whether the 
display size is larger than a half size of the received picture in both a 
vertical direction and a horizontal direction (S210). When the display 
size is larger than the half size of the received picture, the resolution 
selecting unit 23 selects the one half resolution decoding unit 25 to 
decode the received picture. Then, the one half resolution decoding 
unil 25 decodes Ihe piclure in a half resolution in both a vertical and a 
horizontal direction (S21 1), and transfers the decoded picture, that Is, 
data to be displayed to the frame data buffer 28 (S206) . After that, the 
decoded picture is displayed on the display device 3 (S207). 

When the obtained display size is not larger than the half size of 
the received picture in both a vertical and a horizontal direction, the 
resolution selecting unit 23 determines whether the display size is larger 
than one quarter of the size of the received picture in both a vertical 
direction and a horizontal direction (S21 2). When the display size is 
larger than the one quarter of the size of the received picture, the 
resolution selecting unit 23 selects the one quarter resolution decoding 
unit 26 to decode the received picture. Then, the one quarter 
resolution decoding unit 26 decodes the picture in one quarter 
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resolution in both a vertical and a horizontal direction (S213), and 
transfers the decoded picture, that is, data to be displayed to the frame 
data buffer 28 (S206). After that, the decoded picture is displayed on 
the display device 3 (S207). 

When the obtained display size is not larger than the one quarter 
size of the received picture in both a vertical and a horizontal direction, 
the resolution selecting unit 23 selects the one eighth resolution 
decoding unit 27 to decode the received picture. Then, the one eighth 
resolution decoding unit 27 decodes the picture in one eighth resolution 
in both a vertical and a horizontal direction (S214), and transfers the 
decoded picture, that is, data to be displayed to the frame data buffer 28 
(S206). After that, the decoded picture is displayed on the display 
device 3 (S207). 

When a picture which is not at the beginning of GOP is received, 
the resolution selecting unit 23 selects one of the processing units (24 - 
27) which decodes the received picture in the same resolution as the 
previous picture (S21 5). For example, when the previous picture is 
decoded by the one half resolution decoding unit 25 t the current picture 
which is not the beginning of GOP is to be decoded by the one half 
resolution decoding unit 25. 

The decoded picture is transferred to the frame data buffer 28 
(S206). Thereafter, the decoded picture is displayed on the display 
device 3 (S207). 

The resolution selecting unit 23 determines whether moving 
pictures to be displayed remain or not (S21 6). When the Images still 
remain, process returns to step S202 and the next picture is processed- 
On the other hand, all the images are processed, process is ended 
(S217), 
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In the moving picture reproducing device according to the first 
embodiment, at the beginning of decoding process of the original 
images 1 1 , that is, on starting reproduction, decoding process is 
performed in a full resolution. But, a resolution may be determined 
based on a display size which is stored when the previous reproducing 
process of a series of moving pictures is completed. 

Also, in the first embodiment, when a picture which resides at 
the beginning of GOP is received, a display size is obtained by the 
display size obtaining unit 22, since motion compensation of decoding 
process can not be performed successfully If a resolution of a picture Is 
not changed at the beginning of GOP. But, it is desirable to perform 
decoding process in a resolution corresponding to the previous GOP 
when a B picture which resides at the beginning of GOP includes 
information related to an I picture and P picture of the previous GOP. 

As described above, in the first embodiment, speed of decoding 
process of images is improved by performing decoding process in a 
resolution according to a display size of the images. That is, decoding 
process Is effectively neglected In a part of which a user is unaware. 
Therefore, the decoding process is simplified without degradation of 
image quality and reproduction performance is increased. Further, a 
reduced image can be generated regardless of performance of graphic 
hardware. 

[Second Embodiment] 

As shown in Fig* 3, a moving picture reproducing device 
according to a second embodiment of the invention Includes, like In the 
first embodiment, a storage device which stores original images n , an 
image data processing device 2 which is controlled by a program and 
decodes the original images 1 1 , and a display device 3 on which the 
decoded images are displayed. Also, constructive elements shown in 
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Fig. 3 each of which is the same as the corresponding element shown 
in Fig. 1 have the same numeric symbols as the corresponding 
elements shown in Fig. 1. 

In the second embodiment, the image data processing device 2 
includes a compressed data buffer 21 which stores the original images 
1 1 loaded from the storage device 1 , a luminance decoding unit 29 
which decodes luminance component in a half resolution in a vertical 
direction, a color-difference decoding unit 30 which decodes color- 
difference component in a full resolution, and a frame buffer 28 which 
temporarily stores a moving picture to be displayed. 

Next, description is made about operation of the second 
embodiment with reference to Fig. 4. 

At first, the original images 1 1 are loaded from the storage 
device 1 into the image data processing device 2, and then the original 
images 1 1 are transferred to the compressed data buffer 21 (S402). 

The luminance decoding unit 29 decodes, in a half resolution in 
a vertical direction, luminance component in the original images 1 1 
stored in the compressed data buffer 21 (S403). And the color- 
difference decoding unit 30 decodes, in a full resolution, chrominance or 
color-difference component in the original images 1 1 (S404). The 
decoded images are then transferred to the frame data buffer 28 (S205)- 
After that, the decoded images are displayed on the display device 3 
(S406). 

The luminance decoding unit 29 and the color-difference 
decoding unit 30 determines whether the original Images 1 1 to be 
displayed remain or not (S407). When images to be displayed are left, 
process returns to step S402 and the next picture is decoded. 
Otherwise, process is completed (S408). 
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When MPEG data are decoded, luminance component Y and 
color-difference components U and V are obtained. Considering that 
human being is more sensitive to the luminance component than the 
color-difference component, data amount of Y is preferably equal to four 
times of data amount of U or V, That is, a ratio of the data amount of 
the three components can be represented as Y : U : V - 4 : 1 : 1 . 

But, in general, when image data are displayed on a display 
device, the image data are displayed in a ratio Y ; U ; V = 4 ; 2 : 2. 
Therefore, color-difference Information are expanded twice In a vertical 
direction on displaying the image data. 

Thus, when image data are displayed in a lower resolution, if 
about luminance component, decoding process is performed in a half 
resolution and about color-difference components, decoding process is 
performed in an original resolution, the ratio of Y : U ; V becomes equal 
to 4 : 2 : 2. As a result, information content about the color-difference 
components are relatively increased, and image data are displayed with 
being full of color even if the image data are reduced. 

Also, the second embodiment is effectively operable in 
progressive scanning, but in interlace scanning, it can not be operable 
well since a frame used in interlace scanning includes lines each of 
which belongs to an image at a time point or another image at another 
time point. 

As described above, according to the second embodiment, 
decoding process is performed in a lower resolution about luminance 
component, and in an original resolution about color-difference 
components. Thereby, information content about the color-difference 
components are relatively increased, colorful image data can be 
displayed. 
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Also, a scope of the invention is not limited to the above 
mentioned embodiments and it is clear that a person skilled in the art 
can modify and amend the embodiments within the spirit and the scope 
of the invention. Further, it is possible to construct a desirable moving 
picture reproducing device according to the invention independently of 
the number, locations, and shapes of the above mentioned constructive 
elements. 



